Explainable Deep Reinforcement Learning for Portfolio Management: An Empirical Approach
نویسندگان
چکیده
Deep reinforcement learning (DRL) has been widely studied in the portfolio management task. However, it is challenging to understand a DRL-based trading strategy because of black-box nature deep neural networks. In this paper, we propose an empirical approach explain strategies DRL agents for First, use linear model hindsight as reference model, which finds best weights by assuming knowing actual stock returns foresight. particular, coefficients feature weights. Secondly, agents, integrated gradients define weights, are between reward and features under regression model. Thirdly, study prediction power two cases, single-step multi-step prediction. quantify calculating correlations agent similarly machine methods. Finally, evaluate task on Dow Jones 30 constituent stocks during 01/01/2009 09/01/2021. Our empirically reveals that exhibits stronger than
منابع مشابه
Independent Factor Reinforcement Learning for Portfolio Management
In this paper we propose to do portfolio management using reinforcement learning (RL) and independent factor model. Factors in independent factor model are mutually independent and exhibit better predictability. RL is applied to each factor to capture temporal dependence and provide investment suggestion on factor. Optimal weights on factors are found by portfolio optimization method subject to...
متن کاملTransfer Deep Reinforcement Learning in 3D Environments: An Empirical Study
The ability to transfer knowledge from previous experiences is critical for an agent to rapidly adapt to different environments and effectively learn new tasks. In this paper we conduct an empirical study of Deep Q-Networks (DQNs) where the agent is evaluated on previously unseen environments. We show that we can train a robust network for navigation in 3D environments and demonstrate its effec...
متن کاملVisual Analytics for Explainable Deep Learning
Recently, deep learning has been advancing the state of the art in artificial intelligence to a new level, and humans rely on artificial intelligence techniques more than ever. However, even with such unprecedented advancements, the lack of explanation regarding the decisions made by deep learning models and absence of control over their internal processes act as major drawbacks in critical dec...
متن کاملA Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem
Financial portfolio management is the process of constant redistribution of a fund into different financial products. This paper presents a financial-model-free Reinforcement Learning framework to provide a deep machine learning solution to the portfolio management problem. The framework consists of the Ensemble of Identical Independent Evaluators (EIIE) topology, a Portfolio-Vector Memory (PVM...
متن کاملDeep Reinforcement Learning: An Overview
We give an overview of recent exciting achievements of deep reinforcement learning (RL). We start with background of deep learning and reinforcement learning, as well as introduction of testbeds. Next we discuss Deep Q-Network (DQN) and its extensions, asynchronous methods, policy optimization, reward, and planning. After that, we talk about attention and memory, unsupervised learning, and lear...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Social Science Research Network
سال: 2022
ISSN: ['1556-5068']
DOI: https://doi.org/10.2139/ssrn.4061958